Learning engine-based navigation system

ABSTRACT

An aspect of the disclosure relates to a navigation system configured to use GPS or Wi-Fi to navigate users within a structure as well as on roadways. A mapping system may be configured to generate maps and transmit the maps to user devices in association with turn-by-turn instructions. A given user&#39;s current position may be monitored and corrective navigation instructions may be provided. A given user may be navigated to a position of a second user.

INCORPORATION BY REFERENCE TO ANY PRIORITY APPLICATIONS

Any and all applications for which a foreign or domestic priority claimis identified in the Application Data Sheet as filed with the presentapplication are hereby incorporated by reference under 37 CFR 1.57.

COPYRIGHT NOTICE

A portion of the disclosure of this patent document contains materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by anyone of the patent documentand/or the patent disclosure as it appears in the United States Patentand Trademark Office patent file and/or records, but otherwise reservesall copyrights whatsoever.

BACKGROUND OF THE INVENTION Field of the Invention

The present disclosure generally relates to computer-assistednavigation, such as navigation within a structure.

Description of the Related Art

Conventional navigation and search systems often fail to adequatelyenable a user to discover and navigate to a location likely to be ofinterest to the user. Further, conventional systems are not configuredto navigate a user within a structure having a complex internalarchitecture.

SUMMARY

The following presents a simplified summary of one or more aspects inorder to provide a basic understanding of such aspects. This summary isnot an extensive overview of all contemplated aspects, and is intendedto neither identify key or critical elements of all aspects nordelineate the scope of any or all aspects. Its sole purpose is topresent some concepts of one or more aspects in a simplified form as aprelude to the more detailed description that is presented later.

An aspect of the disclosure relates to a navigation system configured touse GPS or Wi-Fi to navigate users within a structure as well as onroadways. Optionally, two or more sources of position data may beutilized (e.g., both GPS data and Wi-Fi triangulation data) to enhancepositioning accuracy and to enhance reliability. A mapping system may beconfigured to generate maps and transmit the maps to user devices inassociation with turn-by-turn instructions. A given user's currentposition may be monitored and corrective navigation instructions may beprovided. A given user may be navigated to a position of a second user.

An aspect of the disclosure relates to a navigation system configured todetect that a first user is at a structure using data received from afirst device. A query regarding an item is received via the firstdevice. An item location within the structure is determined. A firstlocation of the first user at the structure is determined. A firstnavigation route is generated from the first location of the first userto the item location within the structure. The first navigation route istransmitted to the first device in association with at least a portionof a map of a layout of the structure. A request is received from thefirst device. In response to the request, a second navigation route isgenerated from a location of a second user to the item location. Thesecond navigation route is transmitted to a second device in associationwith at least a portion of the map of the layout of the structure.

An aspect of the present disclosure relates to a navigation systemconfigured to perform roadway navigation and establishment layoutnavigation, the system comprising: a network interface; at least oneprocessing device operable to perform operations comprising: receive,via the network interface over a network from a first user device,associated with a first user, a first query regarding a first item;perform a search for establishments satisfying the first query; providesearch results comprising establishments satisfying the first query tothe first user device associated with the first user; receive a firstuser selection of a first establishment from the search results;determine a first current location of the first user; generate a roadwaynavigation route from the first current location of the first user tothe first establishment; cause the roadway generated navigation route tobe transmitted to the first user device and to be displayed inassociation with a roadway map; detect that the first user is at thefirst establishment; determine a second current location of the firstuser, the second current location at the first establishment; determinea location of the first item within the first establishment; generate afirst layout navigation route from the second current location of thefirst user to the location of the first item within the firstestablishment; cause the first layout navigation route from the secondcurrent location of the first user to the location of the first itemwithin the first establishment to be transmitted to and displayed by thefirst user device in association with at least one portion of a map of alayout of the first establishment; receive a first request from thefirst user via the first user device; at least partly in response to thefirst request from the first user, generate a second layout navigationroute from a first current location of a second user to the location ofthe first item; cause the second layout navigation route from the firstcurrent location of the second user to the location of the first itemwithin the first establishment to be transmitted to and displayed by asecond user device, associated with the second user, in association withat least one portion of the map of the layout of the firstestablishment.

Optionally, the operations further comprise cause turn-by-turnnavigations instructions from the first current location of the firstuser to the first establishment for the first roadway navigation routeto be presented on the first user device; cause turn-by-turn navigationsinstructions from the second current location of the first user to thelocation of the first item within the first establishment for the firstlayout navigation route to be presented on the first user device; causeturn-by-turn navigations instructions from the first current location ofthe second user to the location of the first item within the firstestablishment for the second layout navigation route to be presented onthe second user device; and enable the first user and the second user tocommunicate via one or more communication channels. Optionally, theoperations further comprise causing turn-by-turn navigationsinstructions from the second current location of the first user to thelocation of the first item within the first establishment for the firstlayout navigation route to be presented on the first user device.Optionally, the operations further comprise causing turn-by-turnnavigations instructions for the second layout navigation route from thefirst current location of the second user to the location of the firstitem within the first establishment to be presented on the second userdevice. Optionally, the operations further comprise enabling the firstuser and the second user to communicate via one or more communicationchannels. Optionally, at least one of the first roadway navigation routeor the first layout navigation route is generated using a shortest pathalgorithm. Optionally, at least one of the first roadway navigationroute or the first layout navigation route is generated using at leastone of Dijkstra's algorithm, Bellman—Ford algorithm, A* searchalgorithm, or Johnson's algorithm. Optionally, the map of the layout ofthe first establishment comprises a layout of aisles.

An aspect of the present disclosure relates to a method comprising:detecting that a user is at a first establishment using data receivedfrom a first user device associated with the first user; receiving aquery regarding a first item via the first user device; determining alocation of the first item within the first establishment; determining afirst current location of the first user, the first current location atthe first establishment; causing a first navigation route to begenerated from the first current location of the first user to thelocation of the first item within the first establishment; causing thefirst navigation route from the first current location of the first userto the location of the first item within the first establishment to betransmitted to and displayed by the first user device in associationwith at least one portion of a map of a layout of the firstestablishment; receiving a first support request from the first user viathe first user device; at least partly in response to the first supportrequest from the first user, causing a second navigation route to begenerated from a first current location of a second user to the locationof the first item and/or of the first user; causing the secondnavigation route from the first location of the second user to thelocation of the first item and/or of the first user within the firstestablishment to be transmitted to and displayed by a second userdevice, associated with the second user, in association with at leastone portion of the map of the layout of the first establishment.

Optionally, the method further comprises: causing turn-by-turnnavigations instructions from the first current location of the firstuser to the location of the first item within the first establishmentfor the first navigation route to be presented on the first user device;causing turn-by-turn navigations instructions from the first location ofthe second user to the location of the first item and/or the first userwithin the first establishment for the second navigation route to bepresented on the second user device; and enabling the first user and thesecond user to communicate via one or more communication channels.Optionally, the method further comprises: causing turn-by-turnnavigations instructions from the first current location of the firstuser to the location of the first item within the first establishmentfor the first navigation route to be presented on the first user device.Optionally, the method further comprises: causing turn-by-turnnavigations instructions for the second navigation route from the firstlocation of the second user to the location of the first item and/or ofthe first user within the first establishment to be presented on thesecond user device. Optionally, the method further comprises: enablingthe first user and the second user to communicate via one or morecommunication channels. Optionally, at least one of the first navigationroute from the first current location of the first user to the locationof the first item within the first establishment or the secondnavigation route from the first location of the second user to thelocation of the first item and/or of the first user within the firstestablishment is generated using a shortest path algorithm. Optionally,at least one of the first navigation route or the second navigationroute is generated using at least one of Dijkstra's algorithm,Bellman—Ford algorithm, A* search algorithm, or Johnson's algorithm.Optionally, at least one of the first navigation route or the secondnavigation route is generated using a neural network comprising an inputlayer, an output layer, and at least one hidden layer. Optionally, themap of the layout of the first establishment comprises a layout ofaisles. Optionally, the method further comprises: using a learningengine to select, based at least in part on characteristics of the firstuser and characteristics of the first item, usage content for the firstitem; enabling the first user to access the usage content selected usingthe learning engine. Optionally, the method further comprises: accessinglocation information for a plurality of people within at least the firstestablishment in real time; generating, in real time, an analysis basedat least in on the accessed location information for the plurality ofpeople within at least the first establishment; and transmitting theanalysis, generated in real time, to one or more destinations.

An aspect of the present disclosure relates to a non-transitory computerreadable memory having program instructions stored thereon that whenexecuted by a computer system device cause the computer system toperform operations comprising: based at least in part on a communicationfrom a first user device associated with a first user, the communicationinitiated at least partly in response to a camera of the first userdevice capturing an image of optical indicia, detect that a user is at afirst establishment; receive a query regarding a first item via thefirst user device associated with the first user; determine a locationof the first item within the first establishment; determine a firstcurrent location of the first user, the first current location at thefirst establishment; cause a first navigation route to be generated fromthe first current location of the first user to the location of thefirst item at the first establishment; and cause the first navigationroute from the first current location of the first user to the locationof the first item at the first establishment to be transmitted to anddisplayed by the first user device in association with at least oneportion of a map of a layout of the first establishment.

An aspect of the present disclosure relates to a method comprising:detecting that a user is at a first establishment, optionally using datareceived from a first user device associated with the first user;receiving a query regarding a first item via the first user device;determining a location of the first item within the first establishmentand providing an identification of the location of the first user to thefirst user device; receiving a first support request from the first uservia the first user device; at least partly in response to the firstsupport request from the first user, causing an identification of thelocation of the first item and/or of the first user to be provided to adevice of a second user for display.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments will now be described with reference to the drawingssummarized below. These drawings and the associated description areprovided to illustrate example aspects of the disclosure, and not tolimit the scope of the invention.

FIG. 1A illustrates an example operating environment.

FIG. 1B illustrates an example search and navigation systemarchitecture.

FIG. 1C illustrates an example convolutional neural networkarchitecture.

FIGS. 2A-2D illustrate example processes.

FIGS. 3A-3R illustrate example user interfaces.

DETAILED DESCRIPTION

An aspect of the present disclosure relates to systems and methods forenabling users to discover and be navigated to locations of interest,optionally using maps and/or turn-by-turn navigation directions. Anotheraspect of the present disclosure relates to navigating a user within astructure having a complex internal architecture. Yet another aspect ofthe present disclosure relates to navigating a user within a structureto meet another user within the structure.

An aspect of the present disclosure relates to enabling users todiscover and locate products. For example, as similarly describedelsewhere herein, an application may be downloaded to a user device thatenables a user to submit a product search query to a remote system(e.g., a search and navigation system). The remote system mayadvantageously identify matching products and present, in searchresults, the matching products in a ranked order. The ranking of matchesmay be based on a variety of criteria, such as based on the closeness ofthe match, the quality of the matching products, the popularity of thematching products, the ease of use of the matching products, the cost ofthe matching products, the reliability of the matching products, thenumber of warranty claims made for the matching products, the number ofproduct guarantee claims for the matching product, and/or other productcharacteristics.

The search results may advantageously provide a user with access todetailed information regarding a given product. Some or all of thedetailed information may be presented directly in the search results orin response to the user selecting a product in the search results.Examples of detailed information may advantageously include some or allof the following: brand, durability, features, ease of use, userreviews/ratings, identification of similar products, size and dimensioninformation, weight information, performance information, featureinformation, capacity information, compatibility information, durabilityinformation, color information, warranty information, product guaranteeinformation, country of manufacture information, power requirementinformation, and/or other detailed information.

The user may select a product in the search results, and the remotesystem (e.g., the search and navigation system) will identify nearbystores that offer the product. In response to the user selecting aparticular store, the system may advantageously enable navigationinformation to be provided to the user device. Once the user arrives atthe selected store, the system may optionally identify where the productis located within the store and may provide corresponding navigationinformation to the user device (e.g., the aisle and shelf where theproduct is located). When the user is at the product location,optionally the user may utilize the application to request a serviceperson to meet the user (e.g., at the product location within the storeto answer user questions or otherwise assist the user).

Advantageously, the user may be enabled to purchase the product via theapplication on the user device and may further use the application toregister the product (e.g., for product guarantee and/or warrantypurposes). In addition to the convenience offered by such a productpurchase process, the process of registering the product may besubstantially or entirely automated.

Conventionally, a user may have to manually enter data (e.g., purchasername, date of purchase, purchase price, seller name, model number of theproduct, serial number of product purchased, etc.) from a purchasereceipt and elsewhere in order to register a product. However, becausethe product is optionally purchased using the same application that isbeing used to register the product, the application has some or all ofthe information needed to populate an online electronic productregistration form. Thus, the application may utilize the purchase dataand user data (e.g., purchaser name, date of purchase, purchase price,seller name, model number of product purchased, serial number of productpurchased, etc.) to automatically populate the electronic productregistration form. The registration form data received from the userdevice may be stored in memory by the system and/or which may betransmitted to another system (e.g., that of the product manufacturer)for storage.

As described elsewhere herein, the system may advantageously identifyand recommend products that are compatible with or complementary to anacquired product. For example, if the acquired product is a phone,compatible and complementary items might include charging cablescompatible with the phone, screen protectors compatible with the phonescreen size, compatible phone cases, and/or the like. The compatible andcomplementary items may be identified based on historical purchasepatterns (e.g., users who acquire a phone often acquire items usablewith the phone) and/or by and/or by comparing technical specificationsof the acquired item with those of other items. The application on theuser device may present the recommended items and may enable the user topurchase one or more of the recommended items.

Advantageously, the system may select more relevant and usefulinstructional content (text, graphic, photographic, and/or videocontent) on how to utilize an acquired product, and enable such contentto be presented to the user. The instructional content may be selectedusing a learning engine or algorithm based on certain usercharacteristics (e.g., the user's technical sophistication, the user'shistory of accessing instructional content for products, the types ofitem instructional content the user has historically access, and thelike), and/or based on the product type and characteristics.

The system may prompt the user (e.g., via the application hosted on theuser device) to enter a review on a product purchased via theapplication. Optionally, the user is only permitted to post a review fora product after the user has registered the product (e.g., as describedherein). Advantageously, because the system has confirmation that theuser has actually purchased the product, the system can authenticate thereview as being from an actual purchaser of the product and so morelikely to be qualified to review the product. Optionally, the system mayelectronically distribute the authenticated review via one or morechannels. Such channels may include websites of different sellers of theproduct and/or social media platforms (e.g., microblogs, services thatenable friends and business associates to connect, services that enableusers to share content, etc.). The different channels may present agiven review optionally with an indication that the review is from anactual purchaser of the product. Optionally, the system may aggregatereviews (including authenticated reviews) before distributing suchreviews in order to reduce the number of network transactions and toreduce computer system utilization.

The search and navigation system may also generate and distributevarious analytics. Such analytics may provide product manufacturers anddistributors with more insight on desirable product features,information that should be included on product packaging, andinformation on preferred product placement within a retailestablishment. For example, the analytics may show, optionally in realtime, how many consumers are currently in a given establishment or setof establishments, how many consumers in a given establishment or set ofestablishments are currently viewing or evaluating a given product,and/or conversion data for a given product or overall (e.g., how manyconsumers have inquired regarding a given product/scanned an productoptical indicia, how many consumers have placed the given product in anelectronic shopping cart, how many of the given product have beenpurchased, etc.).

An aspect of the present disclosure relates to reputation management.Optionally, the disclosed systems and methods may enable a user'sreviews to be aggregated so that a user may access the user's account,navigate to a review section, and view reviews previously provided bythe user, where the review section user interface may be populated fromuser or review records. For example, the user may access the user'sreviews via the dedicated application described herein or via a browseraccessing the user's account records. Optionally, to enhance security, apassword and/or user identifier may be needed to login to the user'saccount. The password and/or user identifier may be received from theuser device via the application or a browser, and may be verified priorto providing access to the user's account.

The user may optionally share all or selectively share one or more ofthe user's reviews from the review user interface with a set ofdestinations or one or more selected destinations in a set ofdestinations (e.g., electronic sites, such as websites (e.g., commercewebsites)). For example, a user interface may be presented on the userdevice, populated with the user's historical reviews and associatedselection controls (e.g., checkboxes), and optionally a share allcontrol. The user can select, using the selection controls, whichreviews the user wants to share (or if the user wants to share all ofthe user's reviews). In addition, a destination user interface may bepopulated with potential sharing destination and associated selectioncontrols (e.g., checkboxes) and a share with all destination control.The user can select, using the selection controls, which destinationsthe user wants to share the selected reviews with or if the user wantsto share the selected reviews with all of the listed destinations. Thedisclosed systems and methods may store the user's review anddestination selections, and share the reviews accordingly. Optionally,the reviews will only be shared with destinations that include a givenreviewed product in their online catalog and/or are currently offeringthe reviewed product for sale. The destination may then post the reviewon its website and/or in its mobile applications, optionally inassociation with an online catalog document (e.g., a webpage) for thereviewed product.

Certain destinations may require a user to have an account in order tohave the user's review posted in the destination's online catalog. Insuch instances, if the user indicates via a user interface, that theuser has an account, the system may cause the destination's accountlog-in user interface so that the user (or the user's device) canpopulate the log-in user interface with the user's identifier and/orpassword. The destination system may then authenticate the user, andenable the user's review to be posted.

If the user does not have an account with the destination system, thesearch and navigation system may automatically create a destinationaccount for the user. For example, the user may have a user accountrecord with the search and navigation system. The user account recordmay contain user data needed or useful in creating an account for theuser with the destination. Such user data may include, by way ofexample, a user name, a user physical address, a user email address, auser phone number, and/or other user data, such as other user datadescribed herein. The search and navigation system may access an accountcreation user interface associated with the destination website orapplication, parse the account creation user interface (e.g., using anatural language process system) to determine what data is beingrequested for a given user interface field, and populate the parsed userinterface with the user data access from the user record. The search andnavigation system may create or enable the user to create a useridentifier and/or password for the destination user account, which maythen be used in creating the user destination account. The search andnavigation system may store the user identifier and/or password forlater use in future postings of the user's reviews to the destination'swebsite and/or applications.

Thus, when attempting to post a user review with a given destination,the search and navigation system may determine if the destinationrequires a user account in order to post a review. If an account is notrequired, the search and navigation system may post the review using areview posting user interface of the destination (e.g., by parsing thereview posting user interface and determining what data to enter intowhat field (e.g., a user identifier into a review name field, the reviewitself into a review field, etc.)). If the destination requires a useraccount in order to post a review and the user has a user account, thesearch and navigation system may populate or enable the user to populatethe corresponding log-in user interface, then access the review postinguser interface of the destination, parse the reviewing posting userinterface, and post the user's review and other data in the appropriatefields. If the destination requires a user account in order to post areview and the user does not have a user account, the search andnavigation system may create an account as described above, populate thecorresponding log-in user interface, then access the review posting userinterface of the destination parse the reviewing posting user interface,and post the user's review and other data in the appropriate fields.

Optionally, the search and navigation system may track how many reviewsa user has submitted and/or on how many destinations the user's reviewwere posted on. The system may generate a posting performance scorebased at least in part on how many reviews a user has submitted and/oron how many destinations the user's reviews were posted. Optionally, theuser may be given a benefit (e.g., discounts, free products and/orservices, etc.) based at least in part on the posting performance score.The system may transmit (e.g., via a webpage notification, an email, amessaging service message, and/or otherwise) the user's postingperformance score and/or an identification of the benefits provided tothe user.

Optionally, to reduce the amount of interaction between a user deviceand the search and navigation system (thereby reducing utilization ofnetwork and processing bandwidth) and to reduce the amount of timeneeded to enter a review, the system may prepopulate aspects of a reviewform (e.g., of a third party destination) and/or provide a userinterface that enables a user to quickly complete a review.

For example, optionally an artificial intelligence engine (e.g., alearning engine) may be utilized to generate text and/or other contentfor a product review based on a user's definition of the user'sexperience with the product. For example, a user interface may ask theuser to rate, on a certain scale (e.g., Excellent-Good-Acceptable-BelowAverage-Awful, a scale of 1 to 5, A to E, etc.) or to provide a tag orword regarding certain product features and/or factors (e.g., keyfactors or features, such as ease of use, style, reliability, quality ofscreen, quality of camera, etc.). Using the user inputs, a trainedartificial intelligence engine may predict textual descriptions (e.g.,whole sentences and/or paragraphs) that the user would compose, andenter the predicted descriptions into an editable free form review textfield. The user may then be enabled to edit the text generated using theartificial intelligence engine, and the edited text may be saved in theuser's account and/or posted as a user review as described herein.

The artificial intelligence engine may include learning engines, such asneural networks, described elsewhere herein. For example, the neuralnetwork may include an input layer, an output layer, and one or morehidden layers (see, e.g., FIG. 1C). A given layer may include multiplenodes associated with respective weights. The neural network may betrained (e.g., using sequence-to-sequence learning), and the nodeweights may be adjusted using backpropagation to minimize or reduce anerror calculated using an error function. For example, usingsequence-to-sequence learning the neural network may be trained toconvert the input stream of tokens from one domain (e.g., phrasescorresponding to the user's rating or the user's tags) to a stream oftokens in another domain (e.g., full sentence(s) and/or paragraph(s)).The neural network may optionally be implemented using a Long Short TermMemory (LSTM) neural network. The neural network may comprise an encoderand decoder. The neural network encoder may process the inputinformation (e.g., the phrases corresponding to the user rating, theuser's tags, etc.) and capture the context, and generate a contextvector. The context vector is then input by the decoder. The decoderprocesses the context vector and generates the full review (in sentencesand/or paragraphs) as an output.

Optionally, different neural networks may be trained for and use fordifferent demographics or user profiles to reflect the different writingstyles typical of respective demographics or other user characteristics(e.g., for different age groups, different geographical regions,different levels of education, different levels of income, differentuser device types, different user purchase histories, etc.). Then, whena user indicates that they want to submit a review (e.g., by activatinga review submission user interface or a control therein), the userdemographics and/or other characteristics may be accessed from a userrecord, and the appropriate trained neural network may selected andaccessed. The selected neural network then may input the appropriateinput data e.g., the phrases corresponding to the user rating, theuser's tags, etc.) and generate a natural language review that isdifficult or impossible to distinguish from a human written review. Thereview may then be posted as described herein.

As described herein, a search and navigation system, optionallycomprising a learning engine, may be configured to analyze a user queryregarding an item-type of interest to the user, identify suitable itemsof the item type, identify a physical structure in which one or more ofthe suitable items are present, navigate the user to the structure(e.g., by private vehicle, by public transportation, and/or by foot),and navigate the user (e.g., by foot) to a location within the structurewhere one or more of the suitable items are positioned. The search andnavigation system may be further configured to navigate another person(e.g., an employee of the entity operating a business within thestructure) to the user (e.g., where one or more of the suitable item(s)are positioned), so as to assist the user in evaluating or obtaining theitem.

The user may interact with the system via a webservice accessed via abrowser hosted on the user device, via an application dedicated tointeracting with the search and navigation system and optionally otherresources described herein, or otherwise. For example, the dedicatedapplication or browser may be utilized to present user interfacesdescribed herein to the user, to receive data and commands from the userand transmit the system to the search and navigation system, to receivedata from the search and navigation system and present and/or utilizesuch data, and to provide other functions described here. The describedsystems, processes, and user interfaces are configured to provide a userwith a consistent intelligence experience through the various phases ofnavigating to, acquiring and utilizing items.

The search and navigation system may include or have access to one ormore databases that store historical information regarding the user. Inaddition, the search and navigation system may include or have access toone or more databases that store item details (e.g., a productmanufacturer specification database, where the item is a manufacturedproduct).

The historical user information may be stored in association with a useraccount established by the user (e.g., on the system or otherwise). Theinformation may be expressly provided by the user and/or may be obtainedby monitoring the user's queries regarding items, the user's processesof discovering information about items, the user's acquisition of items(e.g., the items, the item types, the item costs, the item brands, theitem colors, the item sizes, the item functions, and/or the like), theuser's access of instructions regarding use of items, the user'sregistration of items, the user's warranty claims, the user's productguarantee claims, and/or otherwise. For example, a database may storeinformation on items that the user has historically acquired (e.g.,phone models, televisions, computers, tablets, furniture, appliances,etc.), brand preferences, whether the user typically selects items onthe low, medium, or high end of a range prices for a given item type,the user's home address, the user's work address, the user's technicalsophistication, the user's store/establishment preferences, and/or otherinformation. If the user issues a query regarding an item (e.g., a phonescreen protector), the learning engine may infer that the user wants anitem (e.g., a screen protector) compatible with an item in the user'spossession (e.g., a phone). The learning engine may access detailsregarding the item (e.g., the screen dimensions), information regardingitems that are the subject of the user query, and identifies items, thatare the subject of the user query, that are compatible with (e.g., thatfit), the item in the user's possession.

The learning engines described herein may be in the form of a neuralnetwork (e.g., feedforward, radial basis, Kohonen, recurrent,convolutional, and/or modular neural network). The learning engines maybe trained using supervised or unsupervised learning. By way of furtherexample, the learning engines may include learning engines in the formof a tree-based machine learning algorithm. (e.g., Classification andRegression Trees, sometimes referred to as “CART”) that performsclassification and regression tasks by building a tree-like structurefor deciding the target variable class or value according to thefeatures, where the CART may be trained using supervised learning. Byway of yet further example, the learning engines may include learningengines in the form of Naïve Bayes Classifier Algorithms, that may betrained using supervised learning. The Naïve Bayes classifier mayclassify a given value as independent of any other value and may be usedto predict, based on a given set of features, a class or category usingprobability.

Optionally, shortest path algorithms may be utilized to navigatevehicles, customers/users, and/or support personnel. For example, one ormore of the following algorithms may be utilized: Dijkstra's algorithm(which solves the single-source shortest path problem with non-negativeedge weight), the Bellman—Ford algorithm (which solves the single-sourceproblem if edge weights may be negative), the A* search algorithm (whichprovides for fast searching by solving for single-pair shortest pathusing heuristic), the Floyd-Warshall algorithm (which solves all pairsshortest paths), or Johnson's algorithm (which solves all pairs shortestpaths, and which may solve the shortest part problem more quickly thanthe Floyd—Warshall algorithm with respect to sparse graphs).

By way of still further example, the learning engines may includelearning engines in the form of support vector machine algorithms thatmay be trained using supervised learning. A support vector machinealgorithm may filter data into categories. By way of additional example,the learning engines may include learning engines in the form oflearning regression algorithms and/or logistic regression algorithms.

Optionally, a combination of different types of learning engines(optionally including two or more of the types of learning enginesdisclosed herein) may be utilized.

After identifying a first set of item of items that satisfy/match a useritem query, the system may filter and/or rank matches based on thecloseness of the match, the quality of the matching items, thepopularity of the matching items, the ease of use of the matching items,the cost of the matching items, the reliability of the matching items,the number of warranty claims made for the matching items, the number ofproduct guarantee claims for the matching item, and/or other itemcharacteristics. The system may cause some or all of the filtered andsorted matching items to be presented on the user device (e.g., via adedicated application or a browser).

The system may detect a user selection of a matching item, determine anavailability of the selected matching item at one or moreestablishments, select one of the establishments (e.g., based ondistance from the user, based on the price set by the establishments forthe item, based on user reviews of the establishments, based on currenttraffic patterns, based on the location of the item within theestablishment (e.g., the shelf height, how far the item is from theestablishment entrance), etc.), and generate a navigation route overroadways to the selected establishment or use a third party navigationservice to generate a route over roadways and provide the user withnavigation instructions to the selected establishment. For example, thesearch and navigation system may provide the third party navigationservice with the user's current location and the address of the selectedestablishment via an application programming interface (API). Inaddition, an API to the third party navigation service may enable thesystem to customize maps with text, imagery, and other content (e.g., animage of the matching item, text identifying the matching item, etc.).

In an example scenario, rather than submitting a query ahead of time foran item, a user may simply go directly to an establishment with theintent of finding the desired item at the establishment. In such ascenario, the user may cause the establishment to be identified to thesearch and navigation system. For example, the user may capture, via acamera of the user device, an image of an optical indicia located on asign, an exterior wall, a window, or at the entrance of theestablishment structure. The optical code may be, by way of example, aone dimensional barcode or a two dimensional barcode (e.g., a QR code).The barcode may optically encode a unique identifier for theestablishment. Where the establishment is part of a chain, the barcodemay also identify the chain.

The user device may transmit the code to the search and navigationsystem, and the search and navigation system may use the code toidentify the user's location. The user may also issue a query regardingthe desired item type to the search and navigation system. The searchand navigation system may identify potential item matches that are inthe establishment inventory. For example, the search and navigationsystem may identify potential matching items as similarly discussedabove (e.g., based on the price of potential matching items, based onreviews of the potential matching items, based on the location of theitem within the establishment (e.g., the shelf height, how far the itemis from the establishment entrance)), access an inventory databaseassociate with the establishment, and determine if the establishment hasmatching items in inventory. The system may rank and filter the matchesbased on the closeness of the match, the quality of the matching items,the popularity of the matching items, the cost of the matching items,and/or other item characteristics. The system may cause some or all ofthe filtered and sorted matching items to be presented on the userdevice (e.g., via a dedicated application or a browser).

The user may select one or more of the presented items. In response tothe user selecting an item, the system may access a layout of theestablishment and stocking location data from a database and determinewhere in the establishment the item is located. For example, anestablishment may be configured with aisles of shelving. The databasemay include inventory location information, indicating where a givenitem or item type is located, such as on which aisle, how far down theaisle from a reference point or at a given coordinate (e.g., x, y or x,y, z coordinates), and on what shelve. The system may use suchinformation to determine the item aisle, aisle position, and shelf.

The system may then transmit item location data (e.g., aisle, aislelocation, and shelf identifiers) to the user device for display to theuser. In addition, a map of at least a portion of the establishmentlayout may be provided for display on the user device. The map mayinclude an indicator (e.g., a graphic and/or text) indicating the user'scurrent location (e.g., as determined from GPS data, Wi-Fi triangulationdata, or other locator data from the user device) and an indicator as tothe item's location.

Optionally, the system may generate a navigation route from the user'scurrent position to the item location. The route may be presented inconjunction with the layout map (e.g., as a line from the user's currentlocation, through the aisle(s), to the item location). Optionally,turn-by-turn instructions may be transmitted for display on the userdevice. Optionally, the user's progress in walking to the item locationis monitored, and the turn-by-turn instructions are updated accordingly.Optionally, if the user misses a turn, a new, corrective, route may begenerated from the user's “off route” position to the item location.

By way of illustration a user may arrive at the item location andevaluate the item. The user may optionally capture an optical code(e.g., a one dimensional or two dimensional barcode) on the itempackaging or on the shelving unit where the item is located. The opticalcode may encode information about the item and/or a link to a resource(e.g., to a webpage) providing information on the item. For example, theinformation may include the name of the item, the item model number, oneor more images of the item, an analysis if the item (e.g., a rating ofthe product, brand, durability, features, ease of use, userreviews/ratings; identification of similar items, and/or video and/orother analysis), size and dimension information, weight information,performance information, feature information, capacity information,compatibility information, durability information, color information,warranty information, product guarantee information, country ofmanufacture information, power requirement information, and/or otherinformation. The item information (e.g., accessed directly from theoptical code or accessed from the linked-to webpage) may then bepresented to the user via the user device (e.g., audibly and/or visuallyvia a dedicated application or a browser hosted on the user device).

The user, viewing and/or listening to the item information, may decidethat the user still has questions or otherwise needs assistance. Theuser may then activate a control presented via the user device (e.g.,via a dedicated application or browser) to initiate the transmission ofa request for assistance. The request may be transmitted by the systemor otherwise to a device associated with one or more support people. Asupport person may be assigned to assist the user. The name and/orphotograph of the support person may optionally be transmitted to andpresented on the user device. Optionally, a control may be providedenabling the user to call, text, or otherwise communicate with thesupport person.

In response to a user request for assistance or automatically, a supportperson at the establishment may be navigated to the user and/or itemlocation. The system may transmit the item and/or user location (e.g.,aisle, aisle location, and shelf identifiers) to the support person'sdevice for display to the support person. In addition, a map of at leasta portion of the establishment layout where the item and/or user arelocated may optionally be provided for display on the support person'sdevice. The map may include an indicator (e.g., a graphic or text) as tothe support person's current location (e.g., as determined from GPSdata, Wi-Fi triangulation data, or other locator data from the userdevice), and an indicator as to the user's and/or item's location. Theitem may also be identified to the support person.

For example, a user interface may present to the support person some orall of the item information presented to the user and/or otherinformation (e.g., a rating of the product, brand, durability, features,each of user, user reviews/ratings; similar items, video and/or otheranalysis), size and dimension information, weight information,performance information, feature information, compatibility information,durability information, color information, warranty information, productguarantee information, country of manufacture information, powerrequirement information, and/or other information). Optionally, the nameand/or photograph of the user may be transmitted to and displayed by theservice person's device. Optionally, a control may be provided enablingthe service person to call, text, or otherwise communicate with theuser.

Optionally, the system may generate a navigation route from the supportperson's current position to the user's or item's location. The routemay be presented in conjunction with the layout map (e.g., as a linefrom the support person's current location, through the aisle(s) to theitem's and/or user's location). Optionally, turn-by-turn instructionsmay be transmitted for display on the support person's device.Optionally, the support person's progress in walking to the user's oritem's location is monitored, and the turn-by-turn instructions areupdated accordingly. Optionally, if the support person misses a turn, anew, corrective, route may be generated from the support person's “offroute” position to the user's or item's location. The service person maythen assist the user in selecting an item. Optionally, a help queue userinterface may be provided for display on the service person's device,where the help queue may contain one or more help requests for one ormore identified items from one or more users. The help queue userinterface may include a description of the items for which assistance isneeded.

If the user desires to acquire the item, the user may add the item to auser electronic shopping cart via the user device (e.g., via a dedicatedapplication or browser), may provide or select payment, and may completethe purchase. Optionally instead, the user may take the item from theitem location to a point of sale device and purchase the item.

The user may then be prompted to register the item. For example, theprompt may be provided via a dedicated application, a browser, an email,a text message or otherwise. Optionally, the system may provide the userwith information on how to use the item. The information may be in theform of textual, graphic, photographic, and/or video instructions. Alearning engine, such as one or more of the learning engines disclosedherein, may be utilized in selecting the informational content presentedto the user based on user characteristics (e.g., the user's technicalsophistication, the user's history of accessing usage information foritems, the device type the user has used to access item usageinformation, etc.) and/or on the item type and characteristics.

In addition, a user may be provided one or more communication channelsto interact with user support, optionally in real time (e.g., via adedicated application, browser, email, texting service, etc.).

A user interface may be provided via which the user can provide a reviewof the item (e.g., provide an overall rating for the item and/or ratingsfor various item characteristics, such as ease of use, durability,reliability, features, and/or the like).

Optionally, a user interface may be provided to the user device thatprovides recommendations as to items compatible or usable with the itemacquired by the user. The recommendations may be generated using alearning engine. The user may select and purchase one or more of therecommended items via the user device. The acquired item and selectedcompatible items may optionally be provided to the user (e.g., by aservice person) while the user is in the establishment or they may bedelivered to a destination specified by the user.

Optionally, the system may be configured to generate various analyticsusing information obtained by the system via the various processes anddatabases described herein. For example, the analytics may show,optionally in real time, how many consumers are currently in a givenestablishment or set of establishments, how many consumers in a givenestablishment or set of establishments are currently viewing orevaluating a given item, and/or conversion data for a given item oroverall (e.g., the how many consumers have inquired regarding a givenitem/scanned an item optical indicia, how many consumers have placed thegiven item in an electronic shopping cart, how many of the given itemhave been purchased, etc.). The foregoing data may also be provided fora historical period of time (e.g., the past 24 hours, the past week, thepast year, or other specified period of time). The foregoing data mayoptionally be presented using a generated graph showing trends over aperiod of time. The foregoing data may be provided broken down bygeographical region (e.g., by zip code, by city, by state, etc.), byestablishment, by set of establishments, by time of day, by day of week,and/or otherwise. The analytics may be provided (e.g., electronicallyover a network) to one or more recipients (e.g., the establishment, theestablishment chain, item distributors, item manufacturers, and/or otherrecipients) textually and/or graphically.

Certain aspects will now be described with reference to the figures.

An example system architecture that may be utilized to perform servicesdescribed herein (e.g., search services, recommendation services,navigation services, communication services, help content services,analytic services, graphing services, and/or other services describedherein) will now be discussed with reference to FIG. 1A. The varioussystems and devices may communicate with each other over one or wiredand/or wireless networks 100 (e.g., the Internet, Ethernet, or otherwide area or local area network). In the illustrated embodiment, asearch and navigation service system 102 may be hosted on one or moreservers. The search and navigation service system 102 may be cloud-basedand may be accessed by one or more user computer systems 110, 112, 114over the network 100. User computer systems 110, 112, 114 and datasource computer systems 104, 106, 108 may be able to share softwareapplications, computing resources, and data storage provided by thesearch and navigation service system 102.

The user computer systems 110, 112, 114 and data source computer systems104, 106, 108 may be in the form of a desktop computer, laptop computer,tablet computer, mobile phone, smart television, dedicated serversystem, cloud-based system, and/or other computing system. The datasource systems 104, 106, 108 may supply various items of data discussedherein, such as user data, item data, establishment data, layout data,navigation data, help and instructional content, analytic data, and/orother data described herein. By way of illustrated example, the datasource systems 104, 106, 108 may include manufacturer product databases,brick and mortar store inventory databases, map databases, locationimage databases (e.g., satellite imagery, traffic signal cameras,security cameras within establishments/stores, etc.), review databases,user account databases, and/or other databases. The data may be pushedby the data source systems 104, 106, 108 (e.g., in real time in responseto new data, or on a scheduled basis), and/or the data may be requestedby the search and navigation service system 102 (e.g., on a scheduledbasis or in response to a user requesting data, such as item data).

A given user computer system and a given data source computer system mayinclude user input and output devices, such as displays (touch ornon-touch displays), speakers, microphones, trackpads, mice, pen input,printers, haptic feedback devices, cameras, and the like. A user systemor data source computer system may include wireless and/or wired networkinterfaces via which the computer systems may communicate with eachother or the search and navigation service system 102 over one or morenetworks.

User interfaces described herein are optionally configured to presentdata (optionally in real time) from sources described herein and toreceive user commands, which may optionally be executed by the searchand navigation service system 102 or other systems in real time or inbatch mode.

A client (e.g., a system browser or a dedicated network resource accessapplication, such as a phone app that provides user interfaces describedherein, hosted by a user computer system) may initiate a handshakingmessage to the search and navigation service system 102. The handshakingmessage may identify the cipher suites supported by the client and othercryptographic information (e.g., the maximum supported version oftransport layer security or secure sockets layer, the client's order ofpreference). The handshaking message may optionally identify datacompression methods supported by the user computer system. Thehandshaking message may include a random byte string that may be used ingenerating encryption keys.

The search and navigation service system 102 may respond to the clientwith a handshaking signal which identifies the cipher suite suit andencryption version (selected from those identified in the clienthandshaking message) that will be used. The search and navigationservice system 102 message may also include a session ID and anotherrandom byte string. The search and navigation service system 102 mayadditionally transmit its digital certificate. The search and navigationservice system 102 may also transmit a client certificate request thatidentifies the types of certificates supported and the DistinguishedNames of acceptable Certification Authorities (CAs), which the clientmay verify.

The random byte string transmitted by the client to the search andnavigation service system 102 may be utilized by both the client and thesearch and navigation service system 102 to generate a secret key thatmay be used for encrypting subsequent message data. Asymmetricencryption may be utilized to generate a shared secret key. The randombyte string itself may be encrypted with the public key of the searchand navigation service system 102.

By way of further example, a given item of data may be encrypted usingan AES-128 key or public key cryptography/asymmetric cryptography. Ifsymmetric encryption is used, then the encryption key and the decryptionkey may be the same key. If public key cryptography/asymmetriccryptography is used, then a public key may be used to encrypt the dataand a private key may be generated to decrypt the data. Thus,communications described herein between a user device and a remotesystem may be performed using the foregoing secure communicationtechnological techniques.

Optionally, a version of the user interfaces described herein may beenhanced for use with a small touch screen (e.g., 4 to 13 inchesdiagonal), such as that of a mobile phone or a tablet computer. Forexample, the orientation of the controls may be relatively more verticalrather than horizontal to reflect the height/width ratio of a typicalmobile device display. Further, the user interfaces may utilizecontextual controls that are displayed in response to an inferred userdesire, rather than displaying a large number of tiny controls at thesame time (which would make them hard to select or manipulate using afinger).

FIG. 1B depicts a block diagram illustrating an embodiment of examplecomponents of the example search and navigation service system 102hosting a resource search and support module 134B configured to identifysuitable items for a user and to provide support to a user, a navigationmodule 136B configured to provide navigation services, and an analytics138B configured to provide real time and historical analytics related toitems and users, such as, by way of example, analytics on real timeand/or historical data related to some or all of the following: how manyconsumers are/were in a given establishment or set of establishments,how many consumers in a given establishment or set of establishments arecurrently/were viewing or evaluating a given item, conversion data(e.g., how many consumers have inquired regarding a given item/scannedan item optical indicia, how many consumers have placed the given itemin an electronic shopping cart, how many of the given item have beenpurchased, etc.), and/or the like, as similarly described elsewhereherein. The system 102 includes an arrangement of computer hardware andsoftware components that may be used to implement aspects of the presentdisclosure. Those skilled in the art will appreciate that the examplecomponents may include more (or fewer) components than those depicted inFIG. 1B.

The navigation module 136B may include a positioning module configuredto determine a user's and/or support persons location (e.g., using GPSsignals from respective devices and/or using a Wi-Fi positioning system(WPS)). Where a WPS is used, coordinates may be defined using Wi-Fiaccess point devices that transmit data. Using a received signalstrength indicator and MAC-address for respective Wi-Fi access pointdevices, the navigation module 136B can define the current location ofthe user's device or the support person's device. Optionally, thenavigation module may utilize multilateration, sometimes referred to ashyperbolic positioning, where an object is located by accuratelycomputing the time difference of arrival (TDOA) of a signal emitted fromthe object to three or more receivers (e.g., Wi-Fi access points). Thenavigation module 136B may include a learning engine configured topredict traffic, and/or identify the shortest and/or simplest path(s) toan establishment or to an item within an establishment.

The system 102 hosting the resource search and support module 134B mayinclude one or more processing units 120B (e.g., a general purposeprocessor and/or a high speed graphics processor with integratedtransform, lighting, triangle setup/clipping, and/or rendering engines),one or more network interfaces 122B, a non-transitory computer-readablemedium drive 124B, and an input/output device interface 126B, all ofwhich may communicate with one another by way of one or morecommunication buses.

The network interface 122B may provide connectivity to andcommunications with one or more networks or computing systems (e.g., oneor more of the systems illustrated in FIG. 1A). The processing unit 120Bmay thus communicate information and instructions to and/or from othercomputing devices, systems, or services via a network. The processingunit 120B may also communicate to and from memory 128B and/ornon-transitory computer-readable medium drive 124B and further provideoutput information via the input/output device interface 126B. Theinput/output device interface 126B may also accept input from one ormore input devices, such as a keyboard, mouse, digital pen, touchscreen, microphone, camera, other sensors, etc.

The memory 128B may contain computer program instructions that theprocessing unit 120B may execute in order to implement one or moreaspects of the present disclosure. The memory 128B generally includesRAM, ROM (and variants thereof, such as EEPROM) and/or other persistentor non-transitory computer-readable storage media. The memory 128B maystore an operating system 132B that provides computer programinstructions for use by the processing unit 120B in the generaladministration and operation of the resource search and support module134B, including its components.

The resource search and support module 134B may include a GUI componentconfigured to generate graphical user interfaces which may be displayedon user systems/devices, a search/match component configured to performsearch and match identification functions as described herein, acommunication component configured to enable customers, supportpersonnel, and systems to communication as described herein, a supportrequest component configured to enable users to request help inselecting an item and/or using an item, and a support content selectioncomponent which may optionally utilize a learning engine is selectingsupport content (e.g., instructions and examples in how to use an item,which may be in the form of text, graphics, photographs, and/or videos).

The memory 128B may store user accounts including, for a given user,user preferences (e.g., brand preferences, establishment preferences,cost preferences, preferences for types of support content, otherpreferences disclosed herein, and/or the like), item purchase historydata, registered items, user technical sophistication, user help requesthistory, user product guarantee claim history, user warranty claimhistory, user home address, user work address, user contact information,and/or other user data discussed herein. Optionally, the memory 128B maycomprise a cloud-based or other networked data store. The account datamay optionally be stored in a relational database, an SQL database, aNOSQL database, a hierarchical database, an object oriented database, agraph database, and/or other database type.

The memory 128B may include an interface module 130B. The interfacemodule 130B can be configured to facilitate generating one or moreinterfaces through which a compatible computing device may send data to,or it may receive data from the system modules.

The modules or components described above may also include additionalmodules or may be implemented by computing devices that may not bedepicted in FIGS. 1A and 1B. For example, although the interface module130B and the navigation module 136B are identified in FIG. 1B as singlemodules, the modules may be implemented by two or more modules and in adistributed manner.

By way of further example, the processing unit 120B may include ageneral purpose processor and a graphics processing unit (GPU). Thesystem hosting the search and support module 134B and the navigationmodule 136B may offload compute-intensive portions of the applicationsto the GPU, while other code may run on the general purpose processor.The GPU may include hundreds or thousands of core processors configuredto process tasks in parallel. The GPU may include high speed memorydedicated for graphics processing tasks. As another example, the systemhosting the various modules and their components can be implemented bynetwork servers, application servers, cloud-base systems, databaseservers, combinations of the same, or the like, configured to facilitatedata transmission to and from data stores, and other party systems viaone or more networks. Accordingly, the depictions of the modules andcomponents are illustrative in nature.

Referring now to FIG. 1C, an example convolutional neural networkarchitecture is illustrated. As discussed herein, a learning engine,such as a neural network, may be configured to analyze a user queryregarding an item-type of interest to the user, identify suitable itemsof the item type, identify a suitable establishment in which one or moreof the suitable items are present, navigate the user to theestablishment (e.g., by private vehicle, by public transportation,and/or by foot), navigate the user (e.g., by foot) to a location withinthe establishment to where one or more of the suitable items arepositioned, navigate a support person to the user or items, and/orselect usage/instructional content to present to the user.

Different types of learning engines may be utilized for different tasks.For example, a recurrent neural network (RNN) may be utilized to solvethe shortest path problem in navigating user vehicles and/or users alonga footpath.

Deep learning may be utilized to model nonlinear interactions in datawith nonlinear activations such as ReLU, Sigmoid, or Tanh. For example,a Multi-Layer Perceptron (MLP) recommendation network may be utilized,the MLP recommendation network configured as a feed-forward neuralnetwork with multiple hidden layers between the input layer and theoutput layer.

A neural network can be used to recommend items similar to those a userhas expressed an interest in (e.g., by selecting one or more items in alist of items of a given type).

Referring again to FIG. 1C, the example neural network includesconvolution+ReLU layers, which together with the pooling layers act asfeature extractors. For example, the convolution+ReLU layers, togetherwith the pooling layers, may act as feature extractors with respect toan input image (e.g., an image of an item the user has expressedinterest in), and the fully connected layer may acts as a classifier.There may be more or fewer layers than those illustrated in FIG. 1C.Further, there does not need to be a pooling layer, and there does notneed to be a pooling layer for each convolution+ReLU layer.

The convolutional neural network may be trained (e.g., to classifyfeatures in an image, to select content suitable for a user, to performnavigation services, etc. The neural network filters and weights may beinitialized with random values. During training, training data may beused as an input to train the neural network to perform identificationand tagging. A forward propagation step may be performed (e.g.,convolution, ReLU, and pooling operations, and forward propagation inthe fully connected layer) and the convolutional neural network maygenerate output probabilities for each class. The total error at theoutput layer may be calculated using an error function. Backpropagationmay be used to update filter values and node weights to reduce orminimize the output error. The weights may be adjusted in proportion totheir contribution to the total error. This process may be repeated formultiple sets of training data (e.g., images of items) so as to trainthe convolutional neural network to correctly identify and classifyimage objects.

Certain example processes will now be described with reference to FIGS.2A-2C. The processes may be executed using one or more of the systemsand devices illustrated in FIGS. 1A-1C and/or as described elsewhereherein.

Referring to FIG. 2A, the illustrated process is applicable todetermining suitable items for a user and to identifying one or moreestablishments that have such suitable items. At block 202A, a user itemquery is received. For example, the user item query may be received froma user device at the search and navigation service system 102. At block204A, the process identifies a set of items matching the item query. Forexample, the process may utilize a learning engine, as describedelsewhere herein, or syntactical features/matching algorithms (e.g.,N-gram matching features, such as BM25F or TF-IDF), and an item databasethat includes item attributes. The identified matching items may beranked based on the closeness of the match.

At block 206A, user data may be accessed (e.g., from a user accountdatabase). The user data may include user brand preferences,establishment preferences, cost preferences, preferences for types ofsupport content, item purchase history data, registered items, usertechnical sophistication, user help request history, user productguarantee claim history, user warranty claim history, user home address,user work address, user contact information, and/or other user datadiscussed herein.

At block 208A, the set of matching items is optionally filtered usingthe user data. For example, certain brands of items may be filtered outif they are not preferred brands. By way of further example, certainitems may be filtered out if their ease of use is low and the user'stechnical sophistication is low. By way of still further example,certain items may be filtered out if they lack support content in a formpreferred by the user (e.g., in a video form). By way of additionalexample, certain items may be filtered out if their cost does not fitthe user's cost preferences.

At block 210A, a set of suitable establishments are identified. Forexample, the inventory of various establishments (e.g., physical stores)may be accessed from respective inventory databases to identify whichestablishments have the items in stock. Optionally, the search may belimited to within a certain geographic area local to the user's homeaddress, work address, and/or the geographical region associated withthe user's IP address, advantageously reducing the amount of computerand network resources needed to perform the inventory search.

At block 212A, the identified set of establishments may be optionallyfiltered using the user data. For example, the user's establishmentpreferences, the availability of parking, the establishment operatinghours, and/or other criteria may be used to filter the set ofestablishments.

At block 214A, the filtered set of items may be presented to the user.For example, the filtered set of items may be transmitted over awireless network to the user's device and presented by a browser ordedicated application hosted on the user device. The presented set ofitems may include information regarding each presented item (e.g., anitem image, an item name, an item cost, an item rating, a brief itemdescription, and/or the like).

At block 216A, a user selection of the presented filtered set of itemsis received over the wireless network from the user device. The user maymake the selection by touching the item in the presented set orotherwise. Advantageously, because only a subset of the matching itemsis transmitted to the user device, the amount of network bandwidth, userdevice memory, user device processing bandwidth, and display area may bereduced.

At block 218A, the previously filtered set of establishments mayoptionally be further filtered to include only those establishments thathave the user selected item in stock (e.g., as determined using the dataobtained at block 210A). At block 220A, the twice filtered set ofestablishments are transmitted for display on the user device.Advantageously, because only a subset of the identified establishmentsis transmitted to the user device, the amount of network bandwidth, userdevice memory, user device processing bandwidth, and display area may bereduced. At block 222A, a user selection of the presented twice filteredset of establishments is received over the wireless network from theuser device.

At block 224A, the user's current location is determined (e.g., asdetermined from position data, such as GPS data, Wi-Fi triangulationdata, a manual entry by the user, or other locator data from the userdevice). Optionally, two or more sources of position data may beutilized (e.g., both GPS data and Wi-Fi triangulation data) to enhancepositioning accuracy and to enhance reliability. The process maygenerate or have generated (e.g., by a third party navigation service asdescribed elsewhere herein) a navigation route from the user's currentlocation to the location of the selected establishment. The route may bepresented on the user device (e.g., presented in conjunction with amap). The route generation may optionally default to vehicularnavigation, with a user-selection option to request navigation by footor public transportation. Optionally, turn-by-turn directions may beprovided for the route which may be displayed by and/or audibly spokenby the user device, thereby enhancing the user device human factorperformance.

At block 226A, a determination is made that the user is at the selectedestablishment. For example, the determination may be made using positiondata determined from GPS data, Wi-Fi triangulation data, a manual entryby the user, or other locator data from the user device. By way offurther example, the determination may be made by the user capturing animage of an optical indicia (e.g., a barcode, such as a QR code) at theselected establishment which causes the user device to access a linkproviding an indication that the user is at the selected establishment.By way of yet further example, the user may “check-in” by activating an“I'm here” control via a dedicated application, browser, or otherwise onthe user device.

At block 228A, the location (e.g., aisle and shelf) of the selected itemwithin the establishment is determined (e.g., from establishment layoutdata accessed from a database). At block 230A, a route is generated fromthe user's current location (e.g., as determined using techniquesdescribed herein) to the item's location using the layout data. Theroute may be transmitted to the user device and presented to the user(e.g., presented in conjunction with a layout map of the establishment).Optionally, turn-by-turn directions may be provided for the route anddisplayed and/or audibly spoken to the user by the user device.

At block 232A, a determination is made that the user is at the itemlocation within the establishment (e.g., as determined using techniquesdescribed herein, such via Wi-Fi positioning, GPS positioning, the userdevice capturing an image of optical indicia, such as a barcode on theitem packaging or otherwise at the item location and accessing a linkencoded in the optical indicia, etc.). At block 234A, detailed iteminformation and analysis may be accessed, transmitted to the userdevice, and displayed to the user. For example, the detailed iteminformation and analysis may optionally include ratings of the product,brand, durability, features, ease of use, capacity. The detailed iteminformation and analysis may optionally include user reviews/ratings,the identification of similar items, video usage information, size anddimension information, weight information, performance information,feature information, compatibility information, durability information,color information, product guarantee information, warranty information,country of manufacture information, power requirement information,and/or other information. For example, the detailed item information andanalysis may be transmitted to and/or presented on the user device atleast partly in response to detecting that the user is at the itemlocation and/or in response to a user request for such information.

At block 236A, a user request for assistance is received from the userdevice (e.g., in response to the user activating an assistance requestcontrol). At block 238A, a determination is made as to which serviceperson is available to respond to the user assistance request. Forexample, the request may be transmitted to multiple service persons'devices, and the user service person that activates an accept controlwill be assigned to service the user request. Optionally, a name orother identifier of user the user may be transmitted to and presented onthe service person's device.

At block 240A, a route (optionally presented in conjunction with alayout map of the establishment) from the service person's presentposition (e.g., determined using techniques described herein) to theuser's and/or item's position may be generated, transmitted to andpresented by the service person's device. Optionally, turn-by-turndirections may be provided for the route to the user's device fordisplay and/or for audible reproduction.

At block 242A, item information and analysis may be transmitted to anddisplayed by the service person's device to enable the service person toassist the user. For example, an item manual, a rating of the product,brand, durability, features, ease of use, user reviews/ratings; similaritems, size and dimension information, weight information, performanceinformation, feature information, compatibility information, durabilityinformation, color information, product guarantee information, warrantyinformation, country of manufacture information, power requirementinformation, item usage images/text/videos, and/or other information andanalysis may be presented. At block 244A, a determination may be madethat the user has added the item to an electronic shopping and/or haspurchased the item. The process may optionally proceed to the processillustrated in FIG. 2C, which will be discussed in greater detailherein.

Referring to FIG. 2B, the illustrated process is applicable todetermining that a user is present at an establishment and identifyingone or more items at the establishment to the user (e.g., where the userdid not first select the establishment from a list generated by thesystem 102). At block 202B, a determination is made that the user is atan establishment. For example, the determination may be made usingposition data determined from GPS data, Wi-Fi triangulation data, amanual entry by the user, or other locator data from the user device.

By way of further example, the determination may be made by the usercapturing an image of an optical indicia (e.g., a barcode, such as a QRcode) which causes the user device to access a link providing anindication that the user is at the establishment. By way of yet furtherexample, the user may “check-in” by activating an “I′m here” control viaa dedicated application, browser, or otherwise on the user device.

At block 204B, a user item query is received. For example, the user itemquery may be received from a user device, while the user is at theestablishment, at the search and navigation system 102. At block 206B,the process identifies a set of items matching the item query. Forexample, the process may utilize a learning engine, as describedelsewhere herein or syntactical features/matching algorithms (e.g.,N-gram matching features, such as BM25F or TF-IDF), and/or an itemdatabase that includes item attributes. The identified matching itemsmay be ranked based on the closeness of the match.

At block 208B, user data may be accessed (e.g., from a user accountdatabase). The user data may include user brand preferences,establishment preferences, cost preferences, preferences for types ofsupport content, item purchase history data, registered items, usertechnical sophistication, user help request history, user productguarantee claim history, user warranty claim history, user home address,user work address, user contact information, and/or other user datadiscussed herein.

At block 210B, the set of matching items is optionally filtered usingthe user data. For example, certain brands of items may be filtered outif they are not preferred brands. By way of further example, certainitems may be filtered out if their ease of use is low and the user'stechnical sophistication is low. By way of still further example,certain items may be filtered out if they lack support content in a formpreferred by the user (e.g., in a video form). By way of additionalexample, certain items may be filtered out if their cost does not fitthe user's cost preferences.

At block 212B, the filtered set of items may be presented to the user.For example, the filtered set of items may be transmitted over awireless network to the user's device and presented by a browser ordedicated application hosted on the user device. The presented set ofitems may include information regarding each presented item (e.g., anitem image, an item name, an item cost, an item rating, a brief itemdescription, and/or the like).

At block 214B, a user selection of the presented filtered set of itemsis received over the wireless network from the user device. The user maymake the selection by touching the item in the presented set orotherwise. Advantageously, because only a subset of the matching itemsis transmitted to the user device, the amount of network bandwidth, userdevice memory, user device processing bandwidth, and display area may bereduced.

At block 216B, the location (e.g., aisle and shelf) of the selected itemwithin the establishment is determined (e.g., from establishment layoutdata accessed from a database).

At block 218B, the user's current location is determined (e.g., asdetermined from position data, such as GPS data, Wi-Fi triangulationdata, a manual entry by the user, or other locator data from the userdevice). Optionally, two or more sources of position data may beutilized (e.g., both GPS data and Wi-Fi triangulation data) to enhancepositioning accuracy and to enhance reliability The process may generateor have generated a navigation route from the user's current location tothe location of the item. The route may be presented on the user device(e.g., presented in conjunction with a map). Optionally, turn-by-turnroute directions may be provided to the user's device for display and/orfor audible reproduction.

At block 220B, a determination is made that the user is at the itemlocation within the establishment (e.g., as determined using techniquesdescribed herein, such via Wi-Fi positioning, GPS positioning, the userdevice capturing an image of optical indicia, such as a barcode on theitem packaging or otherwise at the item location, and accessing a linkencoded in the optical indicia, etc.).

At block 222B, detailed item information and analysis may be accessed,transmitted to, and displayed by the user device to the user (e.g., arating of the product, brand, durability, features, ease of use, userreviews/ratings; similar items, video and/or other analysis; size anddimension information, weight information, performance information,feature information, compatibility information, durability information,color information, product guarantee information, warranty information,country of manufacture information, power requirement information,and/or other information). For example, the detailed item informationand analysis may be transmitted to and/or presented on the user deviceat least partly in response to detecting that the user is at the itemlocation and/or in response to a user request.

At block 224B, a user request for assistance is received from the userdevice (e.g., in response to the user activating an assistance requestcontrol). At block 226B, a determination is made as to which serviceperson is available to respond to the user assistance request. Forexample, the request may be transmitted to multiple service persons'devices, and the user service person that activates an accept controlwill be assigned to service the user request. Optionally, a name orother identifier of the user may be transmitted to and presented on theservice person's device.

At block 228B, a route (e.g., presented in conjunction with a layout mapof the establishment) from the service person's present position (e.g.,determined using techniques described herein) to the user's and/oritem's position may be generated, transmitted to and presented by theservice person's device. Optionally, turn-by-turn directions may beprovided for the route for display and/or for audible reproduction.

At block 230B, item information and analysis may be transmitted to anddisplayed by the service person's device to enable the service person toassist the user. For example, an item manual, a rating of the product,brand, durability, features, ease of use, user reviews/ratings; similaritems, video and/or other analysis, size and dimension information,weight information, performance information, feature information,compatibility information, durability information, color information,product guarantee information, warranty information, country ofmanufacture information, power requirement information, and/or otherinformation and analysis may be presented. At block 232B, adetermination may be made that the user has added the item to anelectronic shopping and/or has purchased the item. The process mayoptionally proceed to the process illustrated in FIG. 2C, which will bediscussed in greater detail herein.

Referring to FIG. 2C, example post-acquisition actions with respect toan item are illustrated. At block 202C, items that may be compatiblewith or complementary to the acquired item are identified. For example,if the acquired item is a phone, compatible and complementary itemsmight include charging cables compatible with the phone, screenprotectors compatible with the phone screen size, compatible phonecases, and/or the like. The compatible and complementary items may beidentified based on historical purchase patterns (e.g., users whoacquire a phone often acquire items usable with the phone) and/or byand/or by comparing technical specifications of the acquired item withthose of other items. The identification of compatible and complementaryitems may be performed using a learning engine, such as a learningengine disclosed herein. The identified compatible with or complementaryitems may be transmitted to the user device for display. At block 204C,the user may be enabled to acquire one or more of the identifiedcompatible or complementary items (e.g., by activating a purchasecontrol or via an establishment point of sale system). If theacquisition is performed while at the establishment, a service personmay deliver the compatible or complementary items to the user prior tothe user leaving the establishment.

At block 206C, the user may be prompted (e.g., via a dedicatedapplication hosted on the user device, via a webpage presented by a userdevice browser, via a text message, via an email, or otherwise) toregister one or more of the acquired items. Registration may includestoring item identifiers (e.g., serial numbers), date of acquisition,and/or price, in association with a user identifier (e.g., emailaddress), and optionally in a user account. In response to suchregistration, the user may be provided with one or more benefits (e.g.,extended product guarantee, extended warranty, enhanced supportservices, etc.). Optionally, if the item is acquired using the sameapplication that is being used to register the item, the application hassome or all of the information needed to populate an item registrationform. Thus, the application may utilize the purchase data and user data(e.g., purchaser name, date of purchase, purchase price, seller name,model number of item purchased, serial number of item purchased, etc.)to populate the item registration form, which may be stored in memory bythe system and/or which may be transmitted to another system (e.g., thatof the item manufacturer) for storage.

At block 208C, the process may select item usage content (e.g.,instructional content, such as text, graphic, photographic, and/or videocontent) for an item acquired by the user. The content may be selectedusing a learning engine or algorithm based on certain usercharacteristics (e.g., the user's technical sophistication, the user'shistory of accessing usage information for items, the types of itemusage content (e.g., where the types may include text, graphic,photographic, and/or video content types), the user's historical accesspercentage for each type of item usage content type, the device type theuser has used to access item usage information, etc.), and/or on theitem type and item characteristics. Optionally, a learning engine, suchas those disclosed herein, may be utilized in selecting such content.The content, in the form of a document or a link to the content, may betransmitted to the user device. The content may then be provided to theuser (e.g., displayed to the user, played back to the user, etc.).

At block 210C, the user is enabled to communicate with a support personwhile in the establishment with the support person (e.g., to assist theuser in analyzing and acquiring an item) or after acquisition of theitem (e.g., for post-purchase support). The communication may beprovided via one or more communication channels, such as audio-onlychannels, audio-video channels, or text channels.

At block 212C, a feedback user interface may be provided (e.g., via adedicated application or a webpage presented via a browser) for displayon the user device via which the user may review or rate an item. Forexample, the user interface may enable the user to provide an overallrating for the item and/or ratings for various item characteristics,such as ease of use, durability, reliability, features, attractiveness,and/or the like. The user feedback may be stored in association with anitem record. The user feedback may be aggregated with that of otherusers and presented to other users, and/or provided to theestablishment, the item distributor, and item manufacturer. For example,the application hosted on the user device may prompt the user to enteran item review on an item acquired via the application. Advantageously,because the process has confirmation that the user has actually acquiredthe item, the process can authenticate the review as being from anactual acquirer of the item. Optionally, the process may distribute theauthenticated review via one or more channels. Such channels may includewebsites of different sellers of the item, via social media (e.g.,microblogs, services that enable friends and business associates toconnect, services that enable users to share content, etc.). Thedifferent channels may present a given user review with an indicationthat the review is from an actual acquirer of the item. Optionally, thesystem may aggregate reviews (including authenticated reviews) beforedistributing such reviews in order to reduce the number of networktransactions and to reduce computer system utilization.

At block 214C, a user interface may be presented on the user device(e.g., via a dedicated application or a webpage presented via a browser)that enables a user to submit a claim (e.g., a claim for a defectiveitem). For example, a user may request or be entitled to a refund of theitem price, a replacement of the item, or a repair of the item. The userinterface may display items previously acquired by the user asdetermined from a user account. The user may select an item from thedisplayed item for which to submit a claim. Alternatively or inaddition, a user may be enabled to submit item identification data(e.g., model name and/or serial number) via one or more correspondingfields. The claim may then be processed by the system.

FIG. 2D illustrates another example process. At block 202D, a system,such as that disclosed herein, detects that the user has registered anitem, such as a product obtained from seller. The registration may havebeen received via a user device (e.g., via a dedicated application or awebsite interface). In response to detecting the registration (whichindicates that the user has actually obtained the item), a feedback userinterface for the item is presented to the user. The feedback userinterface may enable the user to provide a text entry, a score (e.g., arating of 1 to 5), an emoji specification, and/or other feedback. Atblock 206D, the feedback from the user is received from the user device.At block 208D, a feedback distribution interface is provided for displayon the user device (see, e.g., FIG. 3N). The feedback distributioninterface may identify one or more distribution channels (e.g.,websites, applications, social media sites, etc.) with which thefeedback may be shared (e.g., posted). For example, the user may selectone or more of the distribution channels, all the distribution channels,or none of the distribution channels. At block 210D the userspecification of the distribution channels is received.

At block 212D, a determination is made as to whether user authentication(e.g., a user account) is needed in order to post or otherwisedistribute the feedback via a given specified distribution channel. Ifauthentication is not required (e.g., an account with the distributionis not required), at block 214D the feedback may be posted to thedistribution channel and at block 216D the user may be provided withtokens (which may be currency, a discount coupon, loyalty points, orother benefit).

If authentication is required, at block 218D, a determination may bemade as whether the user has existing authentication credentials (e.g.,a password and/or user identification associated with an existing useraccount with the distribution channel). For example, the user may beprompted via a user interface to indicate whether or not the user has anaccount, or a determination may be made via a previous response providedby the user that is stored in a user record. If the user has existingauthentication credentials, the account log-in user interface (see,e.g., FIGS. 3O, 3P) may be presented to the user via the user device sothat the user (or the user's device) can populate the log-in userinterface with the user's authentication credentials (e.g., identifierand/or password). At block 222D, the authentication credentials may besubmitted to the distribution channel authentication system. At block224D, when the user is authenticated, the feedback is posted by thedistribution channel. At block 226D the user may be provided with tokens(which may be currency, loyalty points, a discount coupon, or otherbenefit).

At block 228D, if a determination is made that the user does not have anaccount with the destination system (and corresponding authenticationcredentials) and an account is needed to post feedback, at block 230D, adistribution channel account may be automatically created for the user.For example, the user may have a user account record stored in memorywith the system. The user account record may contain user data needed oruseful in creating an account for the user with the distributionchannel. Such user data may include, by way of example, a user name, auser physical address, a user email address, a user phone number, and/orother user data, such as other user data described herein. The processmay access an account creation user interface associated with thedistribution channel (see, e.g., FIGS. 3Q, 3R), parse the accountcreation user interface (e.g., using a natural language process system)to determine what data is being requested for a given user interfacefield, and populate the parsed user interface with the user data accessfrom the user record. The process may create or enable the user tocreate a user identifier and/or password for the distribution channeluser account, which, at block 232D, may then be submitted and used increating the account. The process may store the user identifier and/orpassword for later use in future postings of the user feedback to thedistribution channel's website and/or applications. At block 234D, thefeedback is posted by the distribution channel. At block 236D the usermay be provided with tokens (which may be currency, loyalty points, adiscount coupon, or other benefit).

Certain example user interfaces will now be discussed with reference toFIG. 3A-3R. As similarly discussed elsewhere herein, the user interfacesmay be presented via an application (e.g., a phone app) hosted on theuser device dedicated to providing certain services described herein,such as enabling a user to submit item queries, view search results,access and view navigation routes, access item data and analysis,communicate with support personnel, access support content, and/orsubmit claims. Optionally, in addition or instead, the user interfacesmay be accessed as webpage via a user device browser via a website.

Referring to FIG. 3A, in response to detecting that a user has arrivedat an establishment (e.g., using GPS location data from the user'sdevice or in response to a user device capturing, using a camera animage of a computer readable optical indicia located at theestablishment, and/or the like), the illustrated query user interfacemay be presented via the user device. The user interface may include afield via which the user can enter an item query. For example, the querymay be in the form of an item type (e.g., a phone) or an item type andbrand name (e.g., Acme Phone). The user interface may include a controlvia which the user can communicate with a support person or bot (e.g.,via a voice call, a video call, or text). The name and/or image of thesupport person may be displayed in association with a communicationcontrol.

Referring to FIG. 3B, an example item detail user interface isillustrated. Optionally, the user interface may be presented on the userdevice in response to a user query or in response to a user selecting anitem in search results provided in response to a user query. The exampleuser interface may include an item name, an item brand, item locationinformation (e.g., the aisle identifier, a location on the aisle, and/ora shelf number), rating information (e.g., a product rating, a brandrating, or types of ratings disclosed herein, etc.), andcomparable/equivalent products. The name and/or image of the supportperson may be displayed in association with a communication control.

Referring to FIG. 3C, an example customer establishment navigation userinterface is illustrated. The user interface may be presented inresponse to a user selecting a navigation control (which may bepresented in association with an item detail user interface orotherwise). The user interface may include a layout map of at least aportion of the establishment, a path marked from the user's currentposition to a user-selected item, and an icon (e.g., a bubble or flag)and/or text identifying the location of the item on the map. Inaddition, text and one or more images may be presented that identify theitem. The item location may also be provided textually (e.g., the aisleidentifier, a location on the aisle, and/or a shelf number), displacedfrom the layout map. The name and/or image of the support person may bedisplayed in association with a communication control.

Referring to FIG. 3D an example help request notification user interfaceis illustrated. The user interface may be presented on a serviceperson's user device in response to a user selecting a help requestcontrol (which may be presented in association with an item detail userinterface or otherwise). The user interface may include text identifyingthe help request and the help request subject matter (e.g., if a user isrequesting aid with respect to mobile device screen protectors, the textmay recite “A customer needs assistance with mobile screen protectors”).Detailed information and analysis may be provided on one or more itemsthat correspond to the user query. For example, the example userinterface may include an item name, an item brand, item locationinformation (e.g., the aisle identifier, a location on the aisle, and/ora shelf number), rating information (e.g., a product rating, a brandrating, or types of ratings disclosed herein, etc.), and anidentification of comparable/equivalent products.

Referring to FIG. 3E, an example service person establishment navigationuser interface is illustrated. The user interface may be presented inresponse to a service person receiving or accepting a user help request.The user interface may include a layout map of at least a portion of theestablishment, a path marked from the service person's current positionto the user or to the user-selected item, and an icon (e.g., a bubble orflag) identifying the location of the item or the user. In addition,text and one or more images may be presented, optionally displaced fromthe layout map, that identify the item and provide information on theitem (e.g., an item rating or textual description of item features). Theitem location may also be provided textually (e.g., the aisleidentifier, a location on the aisle, and/or a shelf number). The nameand/or image of the support person and/or of the user may be displayedin association with a communication control.

Referring to FIG. 3F, an example help queue user interface isillustrated. The user interface may be presented in response to aservice person activating a queue request control. The queue mayidentify items for which users have requested assistance. The items maybe identified by an item type description, a brand name, an item name,an item model number, an item cost, and/or an item image. A given itementry may also identify if there are any associated product guaranteesand the amount of such guarantees. As each help request is serviced, thehelp request may be removed from the help queue in real time.

Referring to FIG. 3G, an example item usage interface is illustrated. Inthis example, the usage interface provides videos of various steps onthe usage and application of an item. The user interface may bescrollable (e.g., via a swipe motion) to enable the user to accessadditional videos for additional steps. A given video may be displayedin association with a given step/sequence number and with atitle/description as to the content of the given video.

Referring to FIG. 3H, an example user interface is illustrateddisplaying items that are compatible with or complementary to anacquired item are identified. Controls may be provided via which theuser may acquire/purchase one or more of the compatible or complementaryitems.

Referring to FIG. 31 , an example analytics user interface isillustrated. The analytics user interface may display, optionally inreal time, how many consumers are in a given establishment or set ofestablishments, how many consumers in a given establishment or set ofestablishments are currently viewing or evaluating a given item, and/orconversion data (e.g., how many consumers have inquired regarding agiven item/scanned an item optical indicia, how many consumers haveplaced the given item in an electronic shopping cart, how many of thegiven item have been purchased, etc.). The foregoing data may also beprovided for a historical period of time (e.g., the past 24 hours, thepast week, the past year, etc.). The foregoing data may be presentedusing a graph showing trends over a period of time. The foregoing datamay be provided broken down by geographical region (e.g., by zip code,by city, by state, etc.). The analytics may be provided to one or morerecipients (e.g., the establishment, the establishment chain, itemdistributors, item manufacturers, and/or other recipients) textuallyand/or graphically.

Referring to FIG. 3J, an example analytics user interface isillustrated. The analytics user interface of FIG. 3J may display,optionally in real time, a map including indicators for one or morestores. In response to a user selecting a given store (e.g., by touchinga corresponding store indicator, hovering a cursor over the storeindicator, clicking on the store indicator, etc.), a graph may bepresented as an overlay indicating the number of user warranty claimsand/or product guarantee claims for respective different products fornumber of products sold. Optionally, the period of time for which thedata is displayed may be selected or otherwise specified.

Referring to FIG. 3K, another example analytics user interface isillustrated. The analytics user interface of FIG. 3K may display,optionally in real time, a map including indicators for one or morestores. In response to a user selecting a given store (e.g., by touchinga corresponding store indicator, hovering a cursor over the storeindicator, clicking on the store indicator, etc.), a graph may bepresented as an overlay indicating the expenditure (e.g., in dollars)servicing user warranty claims and/or product guarantee claims forrespective different products for number of products sold (where thenumber sold may be broken done by demographics of purchasers or claimsubmitters, such as by gender, age, etc.). Optionally, the period oftime for which the data is displayed may be selected or otherwisespecified.

Referring to FIG. 3L, another example analytics user interface isillustrated. The analytics user interface of FIG. 3L may display,optionally in real time, a map including indicators for one or morestores. In response to a user selecting a given store (e.g., by touchinga corresponding store indicator, hovering a cursor over the storeindicator, clicking on the store indicator, etc.), a graph may bepresented as an overlay indicating, for a selected product (e.g., ascreen protector) trending complementary products and new opportunityproducts (where trending may be determined by a threshold number ofsales, or the most popular (e.g., top 5, top 10, etc.) complementaryproducts and new opportunity products). In response to a user selectinga given product indicator (e.g., by touching a corresponding productindicator, hovering a cursor over the product indicator, clicking on theproduct indicator), additional product information may be provided forthe product.

FIG. 3M illustrates an example feedback user interface. For example, thefeedback user interface enables the user to rate an item (e.g., aproduct) as a whole (e.g., 1 to 5 stars) and various characteristicsthat are relevant to the item, such as, in the case of a screenprotector, installation experience, how well the protector protects thedevice, etc. The rating of the characteristics may be performed byselecting amongst predefined choices. A learning engine may optionallyconvert the user's ratings and selections into a text description. Theautomatically generated text description may be used to prepopulate areview text field which the user may optionally be enabled to edit(e.g., delete, modify, or add text). A control is provided via which theuser can submit the feedback.

FIG. 3N illustrates an example feedback distribution user interface. Theuser interface presents several feedback distribution channels (e.g.,ecommerce sites). The user can select one or more of the feedbackdistribution channels via which the user is willing to share the user'sfeedback (e.g., the feedback provided via the user interface illustratedin FIG. 3M).

Thus, among other aspects, a search and navigation system is describedoptionally comprising a learning engine that may be configured toanalyze a user query regarding an item-type of interest to the user,identify suitable items of the item type, identify a physical structurein which one or more of the suitable items are present, navigate theuser to the structure using turn-by-turn directions, and navigate theuser to a location within the structure using turn-by-turn directionswhere one or more of the suitable items are positioned. The search andnavigation system may be further configured to navigate another personto the user.

The methods and processes described herein may have fewer or additionalsteps or states and the steps or states may be performed in a differentorder. Not all steps or states need to be reached. The methods andprocesses described herein may be embodied in, and fully or partiallyautomated via, software code modules executed by one or more generalpurpose computers. The code modules may be stored in any type ofcomputer-readable medium or other computer storage device. Some or allof the methods may alternatively be embodied in whole or in part inspecialized computer hardware. The systems described herein mayoptionally include displays, user input devices (e.g., touchscreen,keyboard, mouse, voice recognition, etc.), network interfaces, etc.

The results of the disclosed methods may be stored in any type ofcomputer data repository, such as relational databases and flat filesystems that use volatile and/or non-volatile memory (e.g., magneticdisk storage, optical storage, EEPROM and/or solid state RAM).

The various illustrative logical blocks, modules, routines, andalgorithm steps described in connection with the embodiments disclosedherein can be implemented as electronic hardware, computer software, orcombinations of both. To clearly illustrate this interchangeability ofhardware and software, various illustrative components, blocks, modules,and steps have been described above generally in terms of theirfunctionality. Whether such functionality is implemented as hardware orsoftware depends upon the particular application and design constraintsimposed on the overall system. The described functionality can beimplemented in varying ways for each particular application, but suchimplementation decisions should not be interpreted as causing adeparture from the scope of the disclosure.

Moreover, the various illustrative logical blocks and modules describedin connection with the embodiments disclosed herein can be implementedor performed by a machine, such as a general purpose processor device, adigital signal processor (DSP), an application specific integratedcircuit (ASIC), a field programmable gate array (FPGA) or otherprogrammable logic device, discrete gate or transistor logic, discretehardware components, or any combination thereof designed to perform thefunctions described herein. A general purpose processor device can be amicroprocessor, but in the alternative, the processor device can be acontroller, microcontroller, or state machine, combinations of the same,or the like. A processor device can include electrical circuitryconfigured to process computer-executable instructions. In anotherembodiment, a processor device includes an FPGA or other programmabledevice that performs logic operations without processingcomputer-executable instructions. A processor device can also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration. Although described herein primarily with respect todigital technology, a processor device may also include primarily analogcomponents. A computing environment can include any type of computersystem, including, but not limited to, a computer system based on amicroprocessor, a mainframe computer, a digital signal processor, aportable computing device, a device controller, or a computationalengine within an appliance, to name a few.

The elements of a method, process, routine, or algorithm described inconnection with the embodiments disclosed herein can be embodieddirectly in hardware, in a software module executed by a processordevice, or in a combination of the two. A software module can reside inRAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory,registers, hard disk, a removable disk, a CD-ROM, or any other form of anon-transitory computer-readable storage medium. An exemplary storagemedium can be coupled to the processor device such that the processordevice can read information from, and write information to, the storagemedium. In the alternative, the storage medium can be integral to theprocessor device. The processor device and the storage medium can residein an ASIC. The ASIC can reside in a user terminal. In the alternative,the processor device and the storage medium can reside as discretecomponents in a user terminal.

Conditional language used herein, such as, among others, “can,” “may,”“might,” “may,” “e.g.,” and the like, unless specifically statedotherwise, or otherwise understood within the context as used, isgenerally intended to convey that certain embodiments include, whileother embodiments do not include, certain features, elements and/orsteps. Thus, such conditional language is not generally intended toimply that features, elements and/or steps are in any way required forone or more embodiments or that one or more embodiments necessarilyinclude logic for deciding, with or without other input or prompting,whether these features, elements and/or steps are included or are to beperformed in any particular embodiment. The terms “comprising,”“including,” “having,” and the like are synonymous and are usedinclusively, in an open-ended fashion, and do not exclude additionalelements, features, acts, operations, and so forth. Also, the term “or”is used in its inclusive sense (and not in its exclusive sense) so thatwhen used, for example, to connect a list of elements, the term “or”means one, some, or all of the elements in the list.

Disjunctive language such as the phrase “at least one of X, Y, Z,”unless specifically stated otherwise, is otherwise understood with thecontext as used in general to present that an item, term, etc., may beeither X, Y, or Z, or any combination thereof (e.g., X, Y, and/or Z).Thus, such disjunctive language is not generally intended to, and shouldnot, imply that certain embodiments require at least one of X, at leastone of Y, or at least one of Z to each be present.

While the phrase “click” may be used with respect to a user selecting acontrol, menu selection, or the like, other user inputs may be used,such as voice commands, text entry, gestures, etc. User inputs may, byway of example, be provided via an interface, such as via text fields,wherein a user enters text, and/or via a menu selection (e.g., a dropdown menu, a list or other arrangement via which the user can check viaa check box or otherwise make a selection or selections, a group ofindividually selectable icons, etc.). When the user provides an input oractivates a control, a corresponding computing system may perform thecorresponding operation. Some or all of the data, inputs andinstructions provided by a user may optionally be stored in a systemdata store (e.g., a database), from which the system may access andretrieve such data, inputs, and instructions. The notifications/alertsand user interfaces described herein may be provided via a Web page, adedicated or non-dedicated phone/mobile device application, computerapplication, a short messaging service message (e.g., SMS, MMS, etc.),instant messaging, email, push notification, audibly, a pop-upinterface, and/or otherwise.

The user terminals described herein may be in the form of a mobilecommunication device (e.g., a cell phone), laptop, tablet computer,interactive television, game console, media streaming device,head-wearable display, networked watch, etc. The user terminals mayoptionally include displays, user input devices (e.g., touchscreen,keyboard, mouse, voice recognition, etc.), network interfaces, etc.

While the above detailed description has shown, described, and pointedout novel features as applied to various embodiments, it can beunderstood that various omissions, substitutions, and changes in theform and details of the devices or algorithms illustrated can be madewithout departing from the spirit of the disclosure. As can berecognized, certain embodiments described herein can be embodied withina form that does not provide all of the features and benefits set forthherein, as some features can be used or practiced separately fromothers. The scope of certain embodiments disclosed herein is indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

1. (canceled)
 2. A navigation system configured to perform roadwaynavigation and structure layout navigation, the system comprising: anetwork interface; at least one processing device operable to performoperations comprising: receive, via the network interface over a networkfrom a first user device at a first structure, associated with a firstuser, a first query regarding a first item type; conduct a search basedat least in part on the first query to identify physical locations ofthe first item type within the first structure; provide, to the firstuser device, ranked search results identifying physical locations of thefirst item type within the first structure; receiving a user selectionof a search result; generate a map indicating a current location of thefirst user device in the first structure and a location of an item inthe first structure corresponding to the selected search result; and atleast partly in response to the first user device capturing an image ofa first optical code, the first user device comprising a camera, enabledata regarding the item corresponding to the selected search result tobe presented via the first user device.
 3. The system as defined inclaim 2, the operations further comprising: cause turn-by-turnnavigations instructions from the current location of the first userdevice within the first structure to the item corresponding to theselected search result in the first structure to be presented on thefirst user device in association with a layout, comprising aisles, ofthe first structure.
 4. The system as defined in claim 2, the operationsfurther comprising, in response to a request for assistance receivedfrom the first user device, queuing the request in a queue, and inresponse to determining what person is going to assist the first user,transmitting an image of the person to the first user device.
 5. Thesystem as defined in claim 2, the operations further comprising enablingthe first user to add the item in the first structure corresponding tothe selected search result into an electronic shopping cart via thefirst user device, and enabling the first user to acquire the item inthe first structure corresponding to the selected search result.
 6. Thesystem as defined in claim 2, the operations further comprising using alearning engine to provide information content regarding the item in thefirst structure corresponding to the selected search result based atleast in part on one or more characteristics of the first user.
 7. Thesystem as defined in claim 2, the operations further comprising using alearning engine to provide a recommendation regarding one or more itemsthat may be compatible or usable with another item associated with thefirst user, and enable the user to obtain a selected item from therecommended one or more items while in the first structure.
 8. Thesystem as defined in claim 2, the operations further comprising using aneural network to generate a textual review of at least one item basedat least in part a user rating, the neural network comprising an inputlayer, an output layer, and at least one hidden layer.
 9. The system asdefined in claim 2, the operations further comprising determining thatthe first user is at the first structure based at least in part on animage viewed by the first user device.
 10. A computer-implementedmethod, the method comprising: receiving, over a network from a firstuser device, associated with a first user, a first query regarding afirst item type; conducting a search based at least in part on the firstquery to identify one or more physical locations of the first item typewithin a first structure; providing, to the first user device, rankedsearch results based on the search; receiving a user selection of asearch result; generating a map indicating a current location of thefirst user device in a first structure and a location of an item in thefirst structure corresponding to the selected search result; and atleast partly in response to determining that the first user device is atthe location of the item in the first structure corresponding to theselected search result, enabling data regarding the item correspondingto the selected search result to be presented via the first user device.11. The computer-implemented method as defined in claim 10, the methodfurther comprising: causing turn-by-turn navigations instructions fromthe current location of the first user device within the first structureto the item corresponding to the selected search result in the firststructure to be presented on the first user device in association with alayout, comprising aisles, of the first structure.
 12. Thecomputer-implemented method as defined in claim 10, the method furthercomprising, in response to a request for assistance received from thefirst user device, queuing the request in a queue, and in response todetermining what person is going to assist the first user, transmittingan image of the person to the first user device.
 13. Thecomputer-implemented method as defined in claim 10, the method furthercomprising enabling the first user to add the item in the firststructure corresponding to the selected search result into an electronicshopping cart via the first user device, and enabling the first user toacquire the item in the first structure corresponding to the selectedsearch result.
 14. The computer-implemented method as defined in claim10, the method further comprising using a learning engine to provideinformation content regarding the item in the first structurecorresponding to the selected search result based at least in part onone or more characteristics of the first user.
 15. Thecomputer-implemented method as defined in claim 10, the method furthercomprising using a learning engine to provide a recommendation regardingone or more items that may be compatible or usable with another itemassociated with the first user, and enabling the user to obtain aselected item from the recommended one or more items while in the firststructure
 16. The computer-implemented method as defined in claim 10,the method further comprising using a neural network to generate atextual review of at least one item based at least in part a userrating, the neural network comprising an input layer, an output layer,and at least one hidden layer.
 17. The computer-implemented method asdefined in claim 10, the method further comprising determining that thefirst user is at the first structure based at least in part on an imageviewed by the first user device.
 18. Non-transitory computer readablememory having program instructions stored thereon that when executed bya computer system cause the computer system to perform operationscomprising: detect that a user is at a first structure; receive' from afirst user device, associated with a first user, a first query regardinga first item type; conduct a search based at least in part on the firstquery to identify one or more physical locations of the first item typewithin the first structure; provide, to the first user device, searchresults using results of the search; receive a user selection of asearch result; generate a map indicating a current location of the firstuser device in the first structure and a location of an item in thefirst structure corresponding to the selected search result; and atleast partly in response to determining that the first user device is atthe location of the item in the first structure corresponding to theselected search result, enable data regarding the item corresponding tothe selected search result to be presented via the first user device.19. The non-transitory computer readable memory as defined in claim 18,the operations further comprising: causing turn-by-turn navigationsinstructions from the current location of the first user device withinthe first structure to the item corresponding to the selected searchresult in the first structure to be presented on the first user devicein association with a layout, comprising aisles, of the first structure.20. The non-transitory computer readable memory as defined in claim 18,the operations further comprising using a neural network to generate atextual review of at least one item based at least in part a userrating, the neural network comprising an input layer, an output layer,and at least one hidden layer.
 21. The non-transitory computer readablememory as defined in claim 18, the operations further comprisingenabling the first user to add the item in the first structurecorresponding to the selected search result into an electronic shoppingcart via the first user device, and enabling the first user to acquirethe item in the first structure corresponding to the selected searchresult.
 22. The non-transitory computer readable memory as defined inclaim 18, the operations further comprising using a learning engine toprovide information content regarding the item in the first structurecorresponding to the selected search result based at least in part onone or more characteristics of the first user.
 23. The non-transitorycomputer readable memory as defined in claim 18, the operations furthercomprising using a learning engine to provide a recommendation regardingone or more items that may be compatible or usable with the another itemassociated with the first user, and enable the user to obtain a selecteditem from the recommended one or more items while in the firststructure.
 24. The non-transitory computer readable memory as defined inclaim 18, the operations further comprising: access location informationfor a plurality of people within at least the first structure in realtime; generating, in real time, an analysis based at least in on theaccessed location information for the plurality of people within atleast the first structure; and transmitting the analysis, generated inreal time, to one or more destinations.
 25. The non-transitory computerreadable memory as defined in claim 18, the operations furthercomprising: enable a user to provide, via a user interface, to rateand/or provide one or more tags for one or more aspects of a firstproduct; accessing a neural network trained to generate a textualreview, the neural network comprising an input layer, an output layer,and one or more hidden layers; providing data corresponding to the userrating and/or one or more tags to the neural network; cause the neuralnetwork to generate the textual review based at least in part on theuser rating and/or one or more tags; receive the textual review from theneural network; and post the textual review from the neural network onone or more destination sites.